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Abstract This study characterized the use of research 
community partnerships (RCPs) to tailor evidence-based 
intervention, training, and implementation models for 
delivery across different childhood problems and service 
contexts using a survey completed by project principal 
investigators and community partners. To build on previ¬ 
ous RCP research and to explicate the tacit knowledge 
gained through collaborative efforts, the following were 
examined: (1) characteristics of studies using RCP models; 
(2) RCP functioning, processes, and products; (3) processes 
of tailoring evidence-based practices for community 
implementation; and (4) perceptions of the benefits and 
challenges of collaborating with community providers and 
consumers. Results indicated that researchers were solely 
or jointly involved in the formation of almost all of the 
RCPs; interpersonal and operational processes were per¬ 
ceived as primary challenges; community partners’ roles 
included greater involvement in implementation and par¬ 
ticipant recruitment than more traditional research 
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activities; and the partnership process was perceived to 
increase the relevance and “fit” of interventions and 
research. 

Keywords Community partnerships • Community 
services • Children • Evidence-based practices 

Introduction 

There is considerable awareness of the gap between evi¬ 
dence-based practices (EBPs) and community-based ser¬ 
vices (Costello et al. 2014; Garland et al. 2013). The growing 
field of implementation science focuses on increasing studies 
and improving methods to promote the systematic uptake of 
research findings and EBPs into community service settings 
(Eccles and Mittman 2006; Rabin and Brownson 2012). 
There are a growing number of implementation frameworks 
and models (Damschroder et al. 2009; Greenhalgh et al. 
2004). A number of these models highlight the critical role of 
research-community partnerships (RCPs) to support the 
relevance and organizational “fit” of interventions to max¬ 
imize uptake and to build organizational infrastructures to 
support intervention sustainability (Aarons et al. 2011; 
Greenhalgh et al. 2004; Mendel et al. 2008; Olsen et al. 2010; 
Smith et al. 2008). National policy directives from the 
National Institute of Mental Health, Centers for Disease 
Control and Prevention, and the Institute of Medicine call for 
improved collaboration between researchers and other 
community stakeholders to enhance the translation of 
research results into community-based care. Most recently, 
The Patient-Centered Outcomes Research Institute (PCORI) 
was authorized by the Patient Protection and Affordable 
Care Act of 2010. This institute was established to “help 
people make better-informed healthcare decisions and 
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improve healthcare delivery and outcomes by producing and 
promoting high-integrity, evidence-based information that 
comes from research guided by patients, caregivers, and the 
broader health care community” (PCORI Methodology 
Committee 2013). Given the increasing explicit attention to 
and funding for research conducted in collaboration with 
community stakeholders, research on the processes of col¬ 
laboration are highly relevant and timely. 

Evidence-based treatments will have the greatest public 
health impact when they are broadly used by community 
stakeholders (including providers and their clients); stake¬ 
holder use depends in large part on the “fit” of the treat¬ 
ment within the community-care context (Aarons et al. 
2011). Researchers who are developing and testing treat¬ 
ment approaches can partner with community stakeholders 
(including providers and clients) to capitalize on comple¬ 
mentary knowledge and expertise, aimed at maximizing 
the research rigor and contextual fit for targeted practices. 
Compared to traditional researcher-driven models of 
research-to-practice translation, partnered research has the 
potential to improve the utility of interventions developed/ 
adapted, the success and efficiency of uptake, the sustain¬ 
ability of interventions in targeted service settings, and the 
ultimate clinical effectiveness with target populations. 

Examples of Research-Community Partnerships 

We use the term research-community partnership (RCP) to 
refer to formal collaborative relationships between 
researchers and community stakeholders regardless of the 
purpose of the collaborative activities and theoretical 
model used to define the partnership. 

There are growing numbers of examples of RCPs in the 
field of mental health services, often influenced by theoret¬ 
ical models of partnerships [e.g., community-based partici¬ 
patory research (Israel et al. 1998); community-partnered 
participatory research (Jones and Wells 2007)]. To date, 
partnerships have been employed to: conduct practice-based 
research to characterize community-based mental health 
care (Garland et al. 2006), promote knowledge exchange 
between researchers, practitioners, and service organizations 
(Sullivan et al. 2005), conduct research that is relevant to 
practice (McMillen et al. 2009), and improve the quality of 
community-based mental health care overall (Lindamer et al. 
2008, 2009; Wells et al. 2004). 

In this paper we specifically focus on RCPs developed to 
select and adapt EBP clinical intervention, training, and 
broader implementation models for child service systems 
(Mental Health, Education, Early Intervention, Child 
Welfare). In addition to the RCPs mentioned above and 
used in community-based research broadly, there are also 
examples of RCPs specifically targeting implementation of 
evidence-based practices in community-based mental 


health services (Chorpita and Mueller 2008; Chorpita et al. 
2002; Southam-Gerow et al. 2009; Wells et al. 2004). 
Community-partnered participatory research (CPPR) is an 
RCP model specifically designed to support efforts to 
implement evidence-based practices in community-based 
mental health services (Jones and Wells 2007; Wells et al. 
2013). This model was designed to support the use of EBP 
in ways that are consistent with community needs and 
values (Wells et al. 2004) and has been applied to examine 
the participatory process in collaboratively selecting and 
testing interventions (Bluthenthal et al. 2006). Taken 
together, the existing RCP research provides important 
information about factors that facilitate (or inhibit) col¬ 
laboration (e.g., trust, shared goals), and anticipated out¬ 
comes of collaborative research (e.g., practice relevant 
research). It also highlights the developmental nature of 
partnerships (from initial formation to sustainable infra¬ 
structure). These studies represent important developments 
in the field in response to calls for improved partnership 
between researchers- and community-stakeholders. 

Our research group has recently focused on addressing 
the need to explicate the collaborative process in child 
mental health services by integrating the extant conceptual 
and empirical literature to develop a framework for RCPs 
in child mental health (Brookman-Frazee et al. 2012; 
Garland and Brookman-Frazee 2013). Figure 1 outlines our 
RCP framework adapted for the current study based on the 
conceptual and theoretical literature as well as “lessons 
learned” from case studies (Brookman-Frazee et al. 2012). 
The framework illustrates the iterative and dynamic pro¬ 
cess of RCP development and the potential outcomes of 
these efforts. It highlights the multiple dynamic phases of 
RCPs and the collaborative processes that occur in the 
community context of the RCP. It posits that RCP func¬ 
tioning (including both interpersonal and operational 
functioning) can lead to partnership synergy (proximal 
outcome), which can then lead to a variety of potential 


Formation l [ Execution of Activities Sustainability 


RCP Functioning Proximal Outcomes Distal Outcomes 



COMMUNITY CONTEXT 


Fig. 1 Model of research community partnerships. Adapted from 
Brookman-Frazee et al. (2012) 
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distal outcomes, including benefits to the individuals 
involved in the RCP, organizations and communities. 

The purpose of the current study is to build on previous 
RCP case studies, theory, and research to make more 
explicit much of the tacit knowledge that many 
researchers have gained through collaborative efforts. 
Specifically, we surveyed principal investigators (Pis) and 
community partners who were directly involved in an 
array of systematically identified studies that used RCP 
approaches to develop, adapt or implement evidence- 
based practices addressing childhood developmental or 
mental health problems. We apply the Brookman-Frazee 
et al. (2012) framework to: (1) characterize projects using 
an RCP approach and collaborative processes, and (2) 
identify themes regarding perceived challenges, benefits 
and lessons learned associated with research-community 
collaboration. 


Methods 

Procedures 

Project and Project Contact Identification Process 

A literature and grants search was conducted to identify 
potential projects eligible for inclusion. The following litera¬ 
ture and grants databases were used: ERIC, PsycINFO, Pub- 
Med, Web of Knowledge, NIH Reporter, the Institute of 
Education Science grants database, the Department of Defense 
grants database, and the Autism Speaks grants database. 
Combinations of the following search terms were used to 
identify articles or grants published or funding initiated 
between 2002 and 2012: “youth/child,” “evidence-based 
practice/intervention,” “CBPR/community-based participa¬ 
tory research/community partnership,” “mental health/devel¬ 
opment,” “community,” and “implementation.” 

The initial search yielded 64 published studies or grant- 
funded projects. A consensus coding process was used to 
determine inclusion. First, three members of the research 
team independently reviewed the abstracts of each study or 
grant to determine initial eligibility based on the following 
eligibility criteria: 

(1) The project included implementation of a specific 
EBP(s) or an adapted EBP intervention targeting 
mental health or developmental problems in youth 
(ages 0-22 years). 

(2) The focus of the project was to adapt the clinical 
intervention, training model, or implementation 
strategy in a targeted community setting(s). 

(3) The intervention was delivered by community pro¬ 
viders in a community service setting (school, mental 


health clinic, specialty developmental clinic/early 
intervention, primary care, child welfare). 

(4) The project involved collaboration (exchange of 
ideas, knowledge or information, shared tasks) 
between researchers and community stakeholders. 

Using these criteria, each of the three reviewers made one 
of the following inclusion recommendations: meets criteria, 
does not meet criteria, unable to determine (i.e., more 
information is needed to make a determination). All three of 
the reviewers agreed on the initial eligibility determination: 
Include (n = 22), Exclude (n = 13) and unable to deter¬ 
mine—more information needed (n = 29). Additional 
information was then obtained for the 29 projects. This 
included reviewing published papers or publicly available 
online information regarding grants projects. The three 
reviewers then reviewed and discussed the additional 
information as a group and made a final inclusion decision. In 
total, 38 of the 64 projects met all four eligibility criteria and 
were included. Email addresses were subsequently identified 
for the study PI or director through publicly available sources 
(e.g., grants databases, publications, university profiles). 

Survey Administration Process 

The web-based survey was emailed to a total of 35 Pis who 
represented the 38 identified projects. Three Pis were involved in 
more than one identified project so they were asked to report on 
the project in which they were most actively involved. Eighteen 
of the 35 Pis responded about 18 unique projects. At the end of 
the survey, Pis were asked to identify community stakeholders 
who were involved in the project. Thirteen of the 18 Pis provided 
emails for a total of 29 community partners. The survey was 
ultimately emailed to a total of 26 community partners (three 
community partners were excluded due to an invalid email 
address). Ten of the 26 community partners responded about 7 
projects. One of the community partners responded about a 
different project than the PI. Therefore, there were 6 projects with 
linked community partner and PI respondents. All survey 
respondents were offered a $10 electronic gift card. The Insti¬ 
tutional Review Boards of the University of California, San 
Diego and Rady Children’s Hospital, San Diego approved sur¬ 
vey content (described below) and distribution procedures. 
Figure 2 depicts the process of final sample selection. 

Participants 

The total sample included 28 survey respondents that 
comprised 18 of the 35 eligible Pis (51 %) and 10 of the 26 
eligible community partners (40 %). Participants were 
75 % female and 86 % White/Caucasian, per self-report. 
Table 1 reports the demographic information collected 
about participants. Note that there were no statistically 
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Fig. 2 Participant sample 
selection 



Table 1 Participant 
demographics 



oo 

II 

s 

CP (n = 10) 

Total (n = 28) 

Age: M (SD); range 

52.06 (9.22); 36-66 

54.70 (8.11); 42-66 

53 (8.78); 36-66 

Gender (%) 

Female 

13 (72 %) 

8 (80 %) 

21 (75 %) 

Race/ethnicity (%) 

White 

16 (89 %) 

8 (80 %) 

24 (86 %) 

Latino/Hispanic 

1 (6 %) 

- 

1 (4 %) 

African American 

1 (6 %) 

1 (10 %) 

2 (7 %) 

Asian/Pacific Islander 

1 (6 %) 

1 (10 %) 

2 (7 %) 


significant differences between Pis and community part¬ 
ners on demographic variables. 

Measures 
Web-Based Survey 

An online software program was used to create and dis¬ 
tribute the web-based survey consisting of 25 items 


(including both multiple choice and open-ended items) 
organized by three primary Sections: 

• Section 1: Project Characteristics Six items includ¬ 
ing: project aims, project funding, service systems 
(e.g., mental health, child welfare) involved in the 
project, age and primarily clinical problem of target 
population, name and primary target of the clinical 
intervention. 
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• Section 2 Collaborative Process Fourteen items includ¬ 
ing: who initiated the research-community partnership, 
community stakeholders involved in the project, brief 
description of how research and community partners 
were identified to participate in the collaborative group, 
use of a theoretical model to structure, and implement, 
or evaluate the research-community partnership, meth¬ 
ods are/were used to communicate and execute project 
activities, level of involvement ratings of any commu¬ 
nity partner on 20 different project activities, role of 
community partners in identifying the clinical inter¬ 
vention, role of community partners in adapting the 
EBP, compensation for community partners for project 
participation, how partner funding was determined, 
continued community partner participation after com¬ 
pletion of the grant/project/funding, percentage of 
community partners have continued participation with 
the project since the beginning, impact of staff turnover 
on ongoing participation, anticipated/actual “products” 
of the research-community partnership. 

• Section 3 Benefits and Challenges of Research-Com¬ 
munity Collaboration Three open-ended items includ¬ 
ing: top four challenges of research-community 
collaboration, top four benefits of research-community 
collaboration, list a key “lesson learned” from your 
experience with research-community collaboration. 

Multiple choice items inquired about characteristics of 
the projects, RCP functioning, processes, and products, and 
processes of tailoring EBPs for implementation in com¬ 
munity settings. Open-ended items inquired about percep¬ 
tions of the benefits and challenges of research-community 
collaboration and lessons learned from the RCP experi¬ 
ence. The survey took approximately 20 min to complete. 

Data Analytic Plan 

Descriptive statistics were performed for multiple choice 
items to describe participant demographics, characteristics 
of projects, and RCP functioning and processes. Open- 
ended items were examined using qualitative data analytic 
methods to describe participants’ perceptions of the bene¬ 
fits and challenges of using RCP approaches and lessons 
learned from their RCP experience. Since only a small 
number of projects had both PI and CP responses (6 of 18), 
PI responses were used to report characteristics of the 
projects and CP involvement (Survey Sections 1 and 2). 
We conducted secondary, exploratory analyses (indepen¬ 
dent sample t tests) to examine difference in perceptions of 
involvement ratings. Further, exploratory analyses (Chi 
square and independent sample t tests) were also conducted 
to compare certain project characteristics and CP 
involvement ratings for those projects with linked CP 


respondents (n = 6 projects) and those without linked CP 
respondents (n = 12 projects). 

Qualitative data (i.e. brief responses to open-ended 
Section 3 questions) were analyzed using a coding, con¬ 
sensus, and comparison methodology (Willms et al. 1990), 
which followed an iterative approach rooted in grounded 
theory (Glaser and Strauss 1967). Qualitative responses 
were brief, ranging between 1 and 2 sentences. These 
responses were assigned codes divided into two levels of 
analysis: (1) general (codes at the broadest level of 
themes), and (2) subthemes (codes at the second level of 
themes and subsumed within a general theme). Two 
members of the research team each coded all qualitative 
responses independently after the final coding list was 
established. Once the coding list was established, the 
coders and PI reviewed of all of the codes for each survey 
until members of the research team reached consensus as to 
which codes should be applied to specific segments of text. 
Quantitative and qualitative data were then integrated 
through triangulation and guided by the RCP framework of 
Brookman-Frazee et al. (2012) in order to examine con¬ 
vergence, expansion, and complementarity as suggested by 
Creswell and Plano Clark (2006). 


Results 

Results are organized according to the Brookman-Frazee 
et al. (2012) framework specifying the Formation Phase, 
collaborative processes, and proximal and distal outcomes. 
PI responses were used to characterize the quantitative data 
gathered for the project characteristics (survey Section 1) 
and collaborative process (survey Section 2) questions. 
Exploratory analyses comparing community partner and PI 
responses regarding collaborative process and differences 
between projects with and without linked community 
partner respondents are integrated in the respective sec¬ 
tions. Themes that emerged from qualitative coding of both 
PI and community partner responses to questions related to 
the collaborative process (survey Section 2) and benefits 
and challenges of research-community collaboration (sur¬ 
vey Section 3) items are integrated to complement and 
expand the findings from PI responses to restricted 
response items. 

Phase 1: Formation (Initiation) of RCPs 

Pis’ responses describing characteristics of the projects 
provides information relevant to the formation of RCPs 
(e.g., purpose of initiating the RCP, members), are sum¬ 
marized in Table 2, outlining project characteristics. As 
noted, the RCPs were primarily initiated by researchers 
(50 %) or jointly initiated (44 %). Agency leaders/ 
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Table 2 Project characteristics 
(based on PI report) 


With linked CP 
respondent 
(n = 6) 

Without linked CP 
respondent 
(n = 12) 

Total 
(n = 18) 


RCP initiation 

Researcher-initiated 

33 % (2) 

58 % (7) 

50 % (9) 


Jointly initiated 

50 % (3) 

42 % (5) 

44 % (8) 


Community stakeholder-initiated 

17 % (1) 

8 % (1) 

11 % (2) 


Funder 

0 % (0) 

8 % (1) 

6 % (1) 


Community stakeholder participants 

Funding agency/system representatives 

50 % (3) 

17 % (2) 

28 % (5) 


Provider agency leaders/administrators 

100 % (6) 

83 % (10) 

89 % (16) 


Clinicians 

100 % (6) 

17 % (2) 

44 % (8) 


Caregiver consumers 

100 % (6) 

67 % (8) 

78 % (14) 


Youth consumers 

17 % (1) 

42 % (5) 

33 % (6) 


Other (community block captains, community teams, 

0 % (0) 

42 % (5) 

28 % (5) 


head start, teachers, school district and partnership) 
Project aim(s) 

Examine intervention effectiveness 

67 % (4) 

75 % (9) 

72 % (13) 


Examine implementation process/outcomes 

83 % (5) 

67 % (8) 

72 % (13) 


Adapt clinical protocol/materials 

67 % (4) 

50 % (6) 

56 % (10) 


Adapt training protocol/materials 

50 % (3) 

33 % (4) 

39 % (7) 


Develop/test a partnership model 

50 % (3) 

33 % (4) 

39 % (7) 


Examine collaborative process 

33 % (2) 

25 % (3) 

28 % (5) 


Other 

17 % (1) 

8 % (1) 

11 % (2) 


Funding 

Federal research grant 

100 % (6) 

83 % (10) 

89 %(16) 


Federal service contract 

0 % (0) 

25 % (3) 

17 % (3) 


Local service contract 

0 % (0) 

8 % (1) 

6 % (1) 


Project service system 

School/special education 

50 % (3) 

42 % (5) 

44 % (8) 


Mental health 

50 % (3) 

42 % (5) 

44 % (8) 


Child welfare 

0 % (0) 

25 % (3) 

17 % (3) 


Early intervention 

17 % (1) 

8 % (1) 

11 % (2) 


Primary care 

0 % (0) 

8 % (1) 

6 % (1) 


Other 

0 % (0) 

25 % (3) 

17 % (3) 


Primary clinical problem 

ASD 

50 % (3) 

0 % (0) 

17 % (3) 


Disruptive behavior disorders 

0 % (0) 

25 % (3) 

17 % (3) 


At risk 

0 % (0) 

17 % (2) 

11 % (2) 


Substance use 

0 % (0) 

17 % (2) 

11 % (2) 


Trauma 

17 % (1) 

8 % (1) 

11 % (2) 


ADHD 

0 % (0) 

8 % (1) 

6 % (1) 


Obesity 

17 % (1) 

0 % (0) 

6 % (1) 


Depression 

0 % (0) 

8 % (1) 

6 % (1) 


Other 

0 % (0) 

8 % (1) 

6 % (1) 


N/A 

17 % (1) 

8 % (1) 

11 % (2) 


RCP model 

CPPR 

67 % (4) 

25 % (3) 

39 % (7) 


CBPR 

17 % (1) 

42 % (5) 

33 % (6) 


Other: PROSPER 

0 % (0) 

8 % (1) 

6 % (1) 

Characteristics are not mutually 

No model used 

17 % (1) 

25 % (3) 

22 % (4) 

exclusive 
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administrators and caregiver consumers represented the 
highest proportions (89 and 78 % of projects, respectively) 
of stakeholder group. When asked to describe how initial 
partners were selected, most Pis indicated that partners 
were at least partially included based on existing rela¬ 
tionships (e.g., Existing relationships first, then leaders 
serving the population). Others indicated that relevant 
stakeholders were selected based on interest or relevance 
(e.g., Researchers and community leaders were identified 
based upon interest and expertise). Exploratory analyses 
comparing characteristics of projects with and without 
community partner respondents revealed that a signifi¬ 
cantly higher proportion with linked community partner 
respondents targeted autism spectrum disorder as the pri¬ 
mary clinical population (50 vs. 0 %) and included clini¬ 
cians as community stakeholders (100 vs. 17 %). 

The most commonly-reported aims of the 18 projects 
were to examine the effectiveness of a specified interven¬ 
tion (72 %) and to examine the implementation process 
and outcomes of an intervention (72 %), with a vast 
majority of projects receiving federal research grant fund¬ 
ing (89 %). Of those 16 projects funded by federal research 
grants, ten received funding from the National Institute of 
Mental Health (NIMH). Other projects funded by federal 
research grants received funding from the National Insti¬ 
tute of Minority Health and Health Disparities (NIMHD, 
n = 2), Centers for Disease Control (CDC, n = 1), 
National Institute on Drug Abuse (NIDA, n = 1), the 
Substance Abuse and Mental Health Services Administra¬ 
tion (SAMHSA, n = 1), and Health Resources and Ser¬ 
vices Administration (HRSA, n = 1). 

Projects were conducted in a range of community ser¬ 
vice systems with the school/special education and mental 
health systems representing the majority of projects (44 % 
each). A variety of youth clinical problems were the focus 
of interventions (e.g., autism spectrum disorders, disruptive 
behavior disorders, substance use). 

Of those projects that endorsed utilizing an RCP theo¬ 
retical model, the majority of Pis reported applying a 
CBPR or CPPR theoretical model (33 and 39 %, 
respectively). 

Research Community Partnership (RCP) Functioning: 
Managing Interpersonal Processes 

Establishing Relationships/Trust 

As mentioned above, initial partnerships were often initi¬ 
ated based on existing relationships or the leadership role 
of the individual in the community or research environ¬ 
ment. Community partners and Pis indicated that rela¬ 
tionships and interaction styles of members provided 


challenges associated with collaboration. For example, 
community partners reported that Not being heard , Possi¬ 
bility of having practice methods criticized , and Lack of 
engagement were interpersonal challenges to the RCP. 
Although less salient for Pis, they commented, Time for 
sufficient communication and relationship development , 
and Building trust were challenging. Multiple Pis com¬ 
mented on the importance of taking time to nurture the 
collaborative relationships. For example, one PI suggested, 
Investment in the relationship is key, critical to all other 
aspects of the project. If you skimp in this area—problems 
will emerge in some other aspect of the project. Addi¬ 
tionally, Pis commented that language and knowledge 
differences between researchers and community stake¬ 
holders (e.g., Different language/meaning of terms, Lack of 
foundational knowledge regarding research/evaluation) as 
challenging. Although this was not as salient a theme for 
community partners, one commented that Acronyms were 
challenging. 

Roles/Responsibilities 

When asked to rate the level of community partner 
involvement in variety of activities on a four-point likert 
scale (1 = Not at all involved; 4 = Very involved), Pis 
reported that, overall (based on a composite of 20 project 
activities) community partners were moderately involved 
in project activities (M = 2.7; SD = 0.75; range 1.5-4.0). 
As illustrated in Fig. 2, the activities with the highest levels 
of community partner involved related to implementation 
planning (M = 3.56; SD = 0.78; range 1-4) and partici¬ 
pant recruitment (M = 3.44; SD = 0.62; range 2-4). Not 
surprisingly, Pis reported that community partners were 
less involved in more traditional research activities such as 
manuscript writing (M = 2.06; SD = 1.03; range 1-4) and 
data analysis (M = 1.53; SD = 0.62; range 1-4). 

Exploratory analyses were conducted to examine differ¬ 
ence in community partner involvement ratings based on 
community partner and PI report for the subset of projects with 
linked community partner and PI ratings (n = 6 projects). 
Although not statistically significant, the average of commu¬ 
nity partner involvement items based on PI report was slightly 
higher than community partners reported (PI: M = 3.03; 
SD = 0.68; CP: M = 2.72; SD = 0.79). Similarly, there 
were no statistically significant differences between commu¬ 
nity partner -rated and Pi-rated community partner involve¬ 
ment on individual items. Additionally, there was generally 
agreement between community partners and Pis in activities 
with the highest and lowest involvement. Specifically, the 
following items were rated the highest for both community 
partners and Pis: Providing feedback on the intervention 
protocol, Providing feedback on the clinical training protocol, 
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Fig. 3 PI report of community 
partner involvement in project 
activities 


Implementation planning 
Participant recruitment 
Intervention implementation 
Leading meetings/setting agendas 
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Revising intervention protocol/materials 
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Participant recruitment, Implementation planning, Selecting 
an intervention; and Revising intervention materials. Like¬ 
wise, both community partners and Pis rated the following 
activities with the lowest involvement ratings: Data analysis, 
Obtaining funding for intervention, Writing papers, and 
Preparing grant applications. 

Exploratory analyses were also conducted to examine 
differences in Pi-rated community partner involvement rat¬ 
ings for those projects with (n = 6) and without (n = 12) 
linked community partner ratings. Although not statistically 
significant, Pis with a linked community partner respondent 
for their project had higher average ratings of community 
partner involvement than Pis without a linked community 
partner respondent (with linked CP: M = 3.03; SD = .68; 
without linked CP: M = 2.50; SD = 0.71). Analyses of 
individual items revealed significantly higher ratings for two 
individual activities. Specifically, Pis with linked community 
partner respondents rated Feedback on intervention protocol 
(M = 4.00; SD = 0.00) higher than Pis without linked 
community partner respondents (M = 2.83; SD = 1.19). 
Similarly, Pis with linked community partner respondents 
rated Revising intervention Materials (M = 3.67; 
SD = 0.62) higher than Pis without linked community 
partner respondents (M = 2.33; SD = 1.37). 

Comments from Pis revealed specific challenges related 
to roles and responsibilities regarding community partners. 
For example, Pis described Task delegation to community 
investigators, Involvement of community stakeholders in 
data analysis, and Equal commitment of effort as chal¬ 
lenges to the collaborative process. One community partner 


also identified the Requirement of ‘additional’ work as a 
challenge (Fig. 3). 

Research Community Partnership (RCP) Functioning: 
Managing Operational Processes 

Leadership and Administrative Support 

The importance of leadership and resources was captured 
by the open ended comment from one PI that Having a 
consistent leader and shared admin support is key, as is 
food at meetings! 

Structure and Communication 

Pis reported on structures used to facilitate communication 
and execute project activities. All Pis reported that tele¬ 
phone or in-person meetings were used for this purpose 
and many reported holding frequent meetings (56 % 
weekly, 44 % monthly). A few Pis added comments that 
the frequency of meetings varied over time. Further, the 
vast majority of Pis (94 %) also reported that email was 
used to facilitate communication and execute project 
activities. Other methods included newsletters (22 %) and 
web-based groups (6 %). Open end-responses indicate that 
challenges regarding scheduling meetings (e.g., Finding 
mutually convenient meeting times) and finding time to 
develop and maintain collaborative relationships (e.g., 
Time for sufficient communication and relationship 
development) were salient for Pis. When asked about 
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lessons learned, multiple Pis mentioned that collaboration 
takes time. 

Phase 2: Execution of Activities 
Proximal (Process) Outcomes 

Partnership Synergy and Collaborative Relationships 

For both Pis and community partners, significant perceived 
benefits of the RCP were the partnership synergy and 
collaborative relationships that developed. For example, 
Pis reported that Establishing partnership towards shared 
goals, Synergy in ideas, and Enthusiasm, interest, and good 
ideas provided by community partners were benefits of the 
RCP. Similarly, community partners reported that [a] Rich 
feedback loop between practitioners and researchers , 
Building and participating in a supportive and reflective 
community , and Collaboration toward common goals were 
benefits of the RCP. Multiple Pis also commented on 
enjoying the collaborative process (e.g., Stimulating and 
fun (never a dull moment)). 

Knowledge Exchange 

Both PI and community respondents also described the value 
of the knowledge exchange that occurred between partners. 
For example, Pis described Learning about the demands of 
community settings , Improved awareness of challenges 
faced for achieving shared goals and Researchers learn 
about the context of community-based care as benefits of 
collaboration. Community partners similarly reported that 
Researchers have a better understanding of how the model 
actually works in community clinics , Sharing of expertise, 
and Informs communities about research. 

Tangible Products 

As indicated in Table 3, Pis reported that a significant 
majority of RCP products were publications and interven¬ 
tion or training materials. Importantly, Pis reported that a 
significant minority of publications and targeted a com¬ 
munity, rather than research, audience. Conference pre¬ 
sentations were more equally distributed across academic 
and community audiences. 

In response to items about the benefits of collabora¬ 
tion and lessons learned, both Pis and community part¬ 
ners commented on the impact of collaboration on RCP 
products. Both respondent groups described how the 
RCP increased the relevance and “fit” of the interven¬ 
tion or materials. Pis’ comments included, Development 
of relevant interventions , Feasible interventions , Sus¬ 
tainable intervention , Better fit between intervention and 


Table 3 PI report of anticipated/actual “products” 


Products 

% (n) Pis 

Research 

audience 

Community 

audience 

Publication focus 

Collaborative process 

78 % (14) 

39 % (7) 

Intervention development process 

78 % (14) 

44 % (8) 

Intervention effectiveness 

78 % (14) 

39 % (7) 

Intervention implementation 

67 % (12) 

28 % (5) 

Conference presentation 

94 % (17) 

83 % (15) 

Intervention materials 

78 % (14) 


Training materials 

78 % (14) 


Intervention training workshops/lectures 

72 % (13) 


Partnership development materials 

44 % (8) 



site, Ultimate product is richer and more sustainable. 
Similarly, community partners described, Meeting the 
needs of the community in an outstanding example of 
evidence-based practice and Model combines principles 
(strong community mindset) and theory (research 
perspective). 

In addition, multiple Pis reported that there was 
enhanced community buy-in for the intervention (e.g., Buy- 
in from target stakeholders , Facilitate provider buy-in ). 

Also related to the impact of the RCP on products, a 
strong theme from Pis was the positive impact of collab¬ 
oration on the research. Specifically, there were a number 
of comments about the relevance of research to practice: 
Ground research in realities of real practice, Relevant 
research questions , Research findings are richer, more 
complex , and Increase feasibility of practice-based 
research. 

Phase 3: Sustainability 
Distal Outcomes 

Both groups of respondents discussed the enhanced quality 
of service delivery, improved outcomes, and the capacity to 
sustain the intervention resulting from the RCP. 

Improved System Capacity Through EBP Implementation 

In response to open-ended questions about perceived ben¬ 
efits and lessons learned, Pis and community partners 
commented about implementation of the intervention and 
improved capacity of agencies or communities. For 
example, a community partner commented that a benefit of 
the RCP was Contributing to the advancement of inter¬ 
vention locally and beyond. Another commented that 
Community agencies stay current on best practices and 
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innovative treatment modes. Similarly, Pis commented on 
the potential for sustained implementation of EBPs (e.g., 
Ability to work with many cohorts over time to more fully 
impact community outcomes , Increased likelihood of sus¬ 
taining the program over time). Both community partners 
and Pis also commented specifically on improved child or 
family outcomes. 

Sustained Capacity of Collaboration 

A majority of Pis (67 %) indicated that community part¬ 
ners will or did continue to participate at the completion of 
the grant/project funding. Twenty-two percent indicated 
that they were “not sure” of community partner continued 
participation. Only 11 % indicated that community part¬ 
ners would not continue to participate in the RCP. A 
majority of Pis (61 %) indicated that 80 % or more of the 
community partners have continued participation with the 
project since the beginning. Further Pis commented in open 
ended responses that a benefit of collaboration was a 
Relationship built for future studies. 

Additional Themes Related to Conducting Community 
Research 

In addition to the themes related to the process of collabo¬ 
ration between researchers and community partners, PI 
comments also reflected tension between research and com¬ 
munity contexts and challenges related to conducting 
research in the community. Multiple Pis commented on 
challenges related to methodological rigor (e.g., Balancing 
methodological rigor with community feedback) and organi¬ 
zational factors impacting research and service delivery (e.g., 
funding, staff turnover). For example, one PI listed Lack of 
foundational knowledge regarding research/evaluation of 
the community partners as a challenge and one noted concern 
that the Control group gets intervention prematurely. 

Discussion 

Overall, this study adds to our understanding of the use of 
RCPs in child-focused community based intervention/ 
implementation research and begins to provide a data- 
based understanding of the benefits and challenges of 
conducting research using RCPs. Projects involving col¬ 
laboration between researchers and community stakehold¬ 
ers to develop, adapt, or implement evidence-based 
practices addressing childhood developmental or mental 
health problems were examined to identify themes related 
to challenges and benefits of using RCPs from the forma¬ 
tion to execution of activities and sustainability phases. 


It is of note that researchers were either solely or jointly 
involved in the formation of almost all of the RCPs. This 
may be a reflection of a recent move by funding agencies to 
require inclusion of community partners in many funding 
mechanisms and the practical necessity of community 
partnerships for successful implementation of EBPs. 
Researchers, then, have clear motivation to seek out rela¬ 
tionships with community stakeholders in the implemen¬ 
tation of these studies. Community members reported value 
in the RCP participation, however they may not have the 
motivation to seek out researchers for such purposes. It is 
also possible that community members seeking to imple¬ 
ment evidence-based services may not think of researcher 
partners as helpful in such endeavors. This perception may 
be accurate as federal research funding, for example, does 
not have as its primary mission to create sustained changes 
to service delivery. Additionally, community members 
may have limited access to researchers with specific 
interest in studying interventions in community settings. 

Primary challenges reported related to difficulties with 
interpersonal and operational processes related to RCP 
functioning, including communication, task delegation and 
time/logistics issues. Communication difficulties often 
included use of technical terms and community members’ 
variable understanding of research methodology. These 
challenges may reflect the broader differences between the 
contexts of research and community services (approaches 
to quality improvement, language, relative emphasis on 
individual vs. group differences). These differences may 
indicate the need for education regarding research methods 
(especially those relevant to the community project), cur¬ 
rent community practice and defining common terms used 
by the research team and those used in community practice 
at the start of a collaborative effort. This type of exercise 
might also help the group to build trust through joint 
learning and working towards a common goal. 

PI reports of task division in RCPs indicated that com¬ 
munity partners were more likely to be involved in tasks 
relating to implementation or participant recruitment, while 
Pis reported involvement in more traditional research 
activities such as manuscript writing and data analysis. 
This task division may reflect a logical distribution of roles 
based on respective areas of expertise. However, examin¬ 
ing ways to cross these boundaries to provide direct 
experience with implementation for researchers and data 
analysis and participation in publication for community 
providers may improve collaboration, trust and under¬ 
standing across disciplines and knowledge exchange. In 
addition, there may be ways to include community partners 
in the development of publications for clinical audiences, 
thereby increasing the reach of the project and providing 
additional education to community providers. 
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Community partner responses were obtained for 
approximately one third of the projects. Exploratory anal¬ 
yses revealed that Pis with a linked community partner 
respondent for their project rated community partner 
involvement higher than Pis without a linked community 
partner respondent. In particular, Pis rated community 
partner involvement in providing feedback on intervention 
protocols and revising intervention materials higher for 
projects with linked partner responses. These findings 
suggest that projects with greater partnership may rely on 
community partners for involvement in the development or 
adaptation of interventions for community delivery. Future 
research should examine whether partner involvement in 
development of an intervention increases the fit of the 
intervention with practice settings. 

Primary benefits were often reported in relation to 
proximal outcomes in which both Pis and community 
partners reported positive perceptions of the strong col¬ 
laborative relationships built through the RCP. In fact, the 
knowledge exchange and relationships appear to be the 
highlight of the process for both groups and may be an 
important element of sustainment over time. Importantly, 
the RCPs were quite productive in terms of publication of 
partnership and intervention results, development of 
intervention and training materials and presenting to both 
academic and community organizations. This productivity 
is likely to be very important to the motivation of both 
research and community partners seeking further career 
development, be it through academic publication or inter¬ 
vention training. 

In addition, Pis clearly saw the value of partnership 
synergy on distal outcomes such as increased intervention 
relevance and fit, improved services/outcomes, and ongo¬ 
ing capacity for continued collaboration. Community 
partners also made positive comments about increased 
community capacity to provide quality services and 
reported improved service outcomes leading directly from 
RCP work. The sustainment of a majority of RCPs beyond 
funding periods highlights the value of such partnerships 
for both community and research participants. Future 
research is needed to determine whether sustained part¬ 
nership infrastructure is associated with sustained 
improvements in the capacity of communities to serve high 
need populations. 

Fimitations 

There are several limitations that may affect the general- 
izability of the results. It would be preferable to have a 
larger number of participants and a higher response rate 
especially from community partners. It is possible that 
community responses were more likely from those with a 
positive experience, especially given that Pis provided 


contact information for community respondents. Further, 
analyses comparing projects with and without community 
partner respondents suggest that partner involvement may 
differ for these projects. As such, community partner 
experiences regarding the challenges and benefits of col¬ 
laboration may not generalize to other partners on other 
projects that have less involvement. Also, the use of a web- 
based survey facilitated data collection, particularly for a 
busy, professional participant sample was necessary; 
however, less text was generated from open response items 
than would have been ideal. The same questions in an 
interview format might have resulted in richer responses, 
but interviews would have added considerable participant 
burden. It is recommended that future research include use 
of in-depth qualitative methods to obtain richer responses. 
Another concern is that the sample was derived from a 
search of databases. In order to be included, partnerships 
had to meet a high threshold of productivity (e.g., publi¬ 
cation or successful grant application) so the sample might 
not be fully representative however, may provide insight 
into processes for the most productive groups. The search 
method likely influenced the high reliance on federal 
funding seen in the participants. There likely are other 
RCPs that did not meet our inclusion criteria. Future 
research is needed that includes alternative methods of 
recruitment to capture a more diverse group of RCP pro¬ 
jects given the potential biases in the types of projects 
examined in the current study. Despite these limitations, 
this study provides novel results which indicate that use of 
RCP approaches are promising in tailoring evidence-based 
practices for delivery in a range of community service 
system settings. 

Additionally, collaboration between researchers and 
community stakeholders is a feasible, productive, and 
valuable method to support or drive research on the 
effectiveness and implementation of interventions in 
community settings. Future research might focus on the 
development of clear strategies to build trust, identify 
community and research partners and to address challenges 
in communication and role distribution. More attention to 
generating resources for partnership work is also needed. 

These results provide preliminary evidence for the value 
of RCPs in developing/adapting EBPs for implementation as 
well as for improving the ongoing capacity of the research 
team to access community settings and participants. 

Acknowledgments This work was supported by K23MH077584. 


References 

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a 
conceptual model of evidence-based practice implementation in 


Springer 




Adm Policy Ment Health 


public service sectors. Administration and Policy in Mental 
Health, 38(1), 4-23. doi:10.1007/sl0488-010-0327-7. 

Bluthenthal, R. N., Jones, L., Fackler-Lowrie, N., Ellison, M., Booker, 
T., Jones, F., et al. (2006). Witness for wellness: preliminary 
findings from a community-academic participatory research 
mental health initiative. Ethnicity and Disease, 16(1), SI. 

Brookman-Frazee, L., Stahmer, A. C., Lewis, K., Feder, J. D., & 
Reed, S. (2012). Building a research-community collaborative to 
improve community care for infants and toddlers at-risk for 
autism spectrum disorders. Journal of Community Psychology, 
40(6), 715-734. doi: 10.1002/jcop.21501. 

Chorpita, B. F., & Mueller, C. W. (2008). Toward new models for 
research, community, and consumer partnerships: Some guiding 
principles and an illustration. Clinical Psychology, 15(2), 
144-148. 

Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A., 
Amundsen, M. J., McGee, C., et al. (2002). Toward large-scale 
implementation of empirically supported treatments for children: 
A review and observations by the Hawaii Empirical Basis to 
Services Task Force. Clinical Psychology, 9(2), 165-190. doi: 10. 
1093/clipsy/9.2.165. 

Costello, E. J., He, J., Sampson, N. A., Kessler, R. C., & Merikangas, K. R. 
(2014). Services for adolescents with psychiatric disorders: 
12-month data from the national comorbidity survey-adolescent. 
Psychiatric Services, 65(3), 1-8. doi: 10.1176/appi.ps.201100518. 

Creswell, J. W., & Plano Clark, V. L. (2006). Designing and 
conducting mixed methods research. Thousand Oaks, CA: Sage 
Publications. 

Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, 
J. A., & Lowery, J. C. (2009). Fostering implementation of 
health services research findings into practice: A consolidated 
framework for advancing implementation science. Implementa¬ 
tion Science, 4, 50. doi: 10.1186/1748-5908-4-50. 

Eccles, M., & Mittman, B. (2006). Welcome to implementation 
science. Implementation Science, 1(1), 1. 

Garland, A. F., & Brookman-Frazee, L. (2013). Therapists and 
researchers: Advancing collaboration. Psychotherapy Research,. 
doi: 10.1080/10503307.2013.838655. 

Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., Baker- 
Ericzen, M., Trask, E., & Fawley-King, K. (2013). Improving 
community-based mental health care for children: Translating 
knowledge into action. [Research Support, N.I.H., Extramural]. 
Administration and Policy in Mental Health, 40(1), 6-22. doi: 10. 
1007/s 10488-012-0450-8. 

Garland, A. F., Plemmons, D., & Koontz, L. (2006). Research- 
practice partnership in mental health: Lessons from participants. 
Administration and Policy in Mental Health, 33(5), 517-528. 
doi:10.1007/sl0488-006-0062-2. 

Glaser, B. G., & Strauss, A. L. (1967). The discovery of ground 
theory: Strategies for qualitative research. Chicago, IL: Aldine 
Publishing Company. 

Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, 
O. (2004). Diffusion of innovations in service organizations: 
Systematic review and recommendations. Milbank Quarterly, 
82(4), 581-629. doi: 10.1 lll/j.0887-378X.2004.00325.x. 

MILQ325. 

Israel, B. A., Schulz, A. J., Parker, E. A., & Becker, A. B. (1998). 
Review of community-based research: Assessing partnership 
approaches to improve public health. [Review]. Annual Review 
of Public Health, 19, 173-202. 


Jones, L., & Wells, K. (2007). Strategies for academic and clinician 
engagement in community-participatory partnered research. 
JAMA, 297(4), 407-410. doi:10.1001/jama.297.4.407. 

Lindamer, L., Lebowitz, B., Hough, R., Garcia, P., Aguirre, A., 
Halpain, M., et al. (2009). Establishing an implementation 
network: Lessons learned from community-based participatory 
research. Implementation Science, 4(1), 17. 

Lindamer, L. A., Lebowitz, B. D., Hough, R. L., Garcia, P., Aquirre, A., 
Halpain, M. C., et al. (2008). Public-academic partnerships: Improv¬ 
ing care for older persons with schizophrenia through an academic- 
community partnership. Psychiatric Services, 59(3), 236-239. 

McMillen, C. J., Lenze, S. L., Hawley, K. M., & Osborne, V. A. (2009). 
Revisiting practice-based research networks as a platform for 
mental health services research. Administration and Policy in 
Mental Health, 36(5), 308-321. doi:10.1007/sl0488-009-0222-2. 

Mendel, P., Meredith, L. S., Schoenbaum, M., Sherboume, C. D., & 
Wells, K. B. (2008). Interventions in organizational and 
community context: A framework for building evidence on 
dissemination and implementation in health services research. 
Administration and Policy in Mental Health, 35(1-2), 21-37. 
doi:10.1007/sl0488-007-0144-9. 

Olsen, L. A., McGinnis, M. J., & Roundtable on Value & Science- 
Driven Health Care, & Institute of Medicine. (2010). Redesign¬ 
ing the Clinical Effectiveness Research Paradigm: Innovation 
and Practice-Based Approaches: Workshop Summary. Wash¬ 
ington, DC: The National Academies Press. 

PCORI (Patient-Centered Outcomes Research Institute) Methodology 
Committee. (2013). The PCORI Methodology Report. 

Rabin, B. A., & Brownson, R. C. (2012). Developing the terminology 
for dissemination and implementation research (1st ed.). New 
York: Oxford University Press. 

Smith, J. L., Williams, J. W, Jr, Owen, R. R., Rubenstein, L. V., & 
Chaney, E. (2008). Developing a national dissemination plan for 
collaborative care for depression: QUERI Series. Implement 
Science, 3, 59. doi: 10.1186/1748-5908-3-59. 

Southam-Gerow, M. A., Hourigan, S. E., & Allin, R. B, Jr. (2009). 
Adapting evidence-based mental health treatments in community 
settings: Preliminary results from a partnership approach. 
Behavior Modification, 33(1), 82-103. doi: 10.1177/ 

0145445508322624. 

Sullivan, G., Duan, N., Mukherjee, S., Kirchner, J., Perry, D., & 
Henderson, K. (2005). The role of services researchers in 
facilitating intervention research. Psychiatric Services (Wash¬ 
ington, DC), 56(5), 537-542. doi:10.1176/appi.ps.56.5.537. 

Wells, K. B., Jones, L., Chung, B., Dixon, E. L., Tang, L., Gilmore, J., 
et al. (2013). Community-partnered cluster-randomized compar¬ 
ative effectiveness trial of community engagement and planning 
or resources for services to address depression disparities. 
Journal of General Internal Medicine, 23(10), 1268-1278. 
doi: 10.1007/s 11606-013-2484-3. 

Wells, K. B., Miranda, J., Bruce, M. L., Alegria, M., & Wallerstein, 
N. (2004). Bridging community intervention and mental health 
services research. American Journal of Psychiatry, 161(6), 
955-963. 

Willms, D. G., Best, A. J., Taylor, D. W., Gilbert, J. R., Wilson, D. 
M. C., Lindsay, E. A., & Singer, J. (1990). A systematic 
approach for using qualitative methods in primary prevention 
research. Medical Anthropology Quarterly, 4, 391-409. 


<£) Springer 



